Papers with NLP application
ANHALTEN: Cross-Lingual Transfer for German Token-Level Reference-Free Hallucination Detection (2024.acl-srw)
Copied to clipboard
| Challenge: | ANHALTEN is a new evaluation dataset that extends the English hallucination detection dataset to German. |
| Approach: | They propose a dataset that extends the English hallucination detection dataset to German . they show that larger context length leads to better halluciation detection in german . |
| Outcome: | ANHALTEN is the first evaluation dataset that extends the English hallucination detection dataset to German. |
Domain Divergences: A Survey and Empirical Analysis (2021.naacl-main)
Copied to clipboard
| Challenge: | Existing literature on divergence measures is lacking in predicting performance of models in new domains. |
| Approach: | They propose a taxonomy of divergence measures consisting of three classes — Information-theoretic, Geometric, and Higher-order measures and identify the relationships between them. |
| Outcome: | The proposed measures are based on three novel use-cases and identify that they are prevalent in three domains and higher-order measures are more common in two. |
Probing for Semantic Classes: Diagnosing the Meaning Content of Word Embeddings (P19-1)
Copied to clipboard
| Challenge: | Empirical analysis of word embeddings of ambiguous words is limited by the small size of manually annotated resources and by the fact that word senses are treated as unrelated individual concepts. |
| Approach: | They present a large dataset based on manual Wikipedia annotations and word senses, where word sense from different words are related by semantic classes. |
| Outcome: | The proposed method can predict whether a word is single-sense or multi-sensor, if the sense is frequent, and it can predict rare senses. |